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ABSTBACT 

This paper builds a strategy for vayis in vhich 
instruction can be improved through research. The strategy is cne 
that thinks of instructional changes as those that promise to make 
significant differences in instructional outcomes and then determines 
whether or not these changes fulfill their promises. The document 
cites evidence that supports the need for improvement in normal 
instruction, and then describes the author's strategy in three steps. 
The educational change strategist is enjoined to first define, 
classify, and schedule instructional objectives in terms of student 
performance; then analyze the performances to produce a specification 
of the demands they make on learners and to find analagous nonschool 
tasks that make these same demands (these tasks can also be used for 
research purposes); and finally formulate and test hypotheses that 
identify the principal sources of variance in attaining mastery of 
these tasks. The author then considers tvo hypotheses about the 
principal sources o£ variance in attaining mastery of tasks and 
spec.^lates as to what instruction might be like if research were to 
produce evidence of their viability. (Author/DH) 
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In research, there are few guidelines for making strategy decisions. 
How do we decide what questions to ask? How do we decide which questions 
to ask first? How do we decide whether or not we have an answer? These 
are all complicated issues and we do not have routines for resolving them. 
But they are precisely the kinds of issues that are raised by the topic of 
i]iq>roving instruction through research. 

The purpose of this paper is to build a case for: one kind of strategy. 
In brief, the strategy is to think of changes in instruction that promise to 
make significant differences in Its outcomes and then to determine whether 
or not they do. The key word is "significant." As used here, it has 
nothing to do with statistics. Bluntly speaking, it means "large," on 
an absolute scales Before concentrating on this strategy^ however^ it is 
necessary to deal with a prior issue, that is, the rationale for believing' 
that instruction needs improving^ 

Signs That Instruction Needs Improving 
An intent to improve instruction implies that there are some deficiencies 
in it. The ways we index these deficiencies are import^int since they will 



This report was facilitated, in part, by a grant from the National 
Institutes of Health (HD03869). It was prepared at the Institute of Human 
10 Learning which is supported by grants from the National Institutes of Health. 

S 2 

^ Invited Address presented at the annual meeting of the American 

^ Educational Research Association, New 0rl2ans» 1973. 



determine where we look for solutions. For example » If the principal 
deficiency of Instruction Is that gifted students do not realize their full 
academic potential, then the bulk of current Instructional theory and practice 
can be left Intact. Research effort can be concentrated on conditions that 
foster maximum growth In the gifted. In contrast, if instruction is 
deficient for a majority of the population, research should focus on more 
fundamental and comprehensive issues. 

One index of Instructional deficiency <that ml.ght be generally recognized 
for its validity is rate of scholastic failure. A number of variables can 
be used as indicators of scholastic failure: for example, teacher grades » 
and standardized test scores. Unfortunately, neither of these is optimal 
for present purposes, because they provide a relative index of student 
performance and a relative yardstick is not the best kind for making an 
absolute Judgments of the sort implied by the concept of failure. Never- 
theless, we will adopt them here, mainly for lack of a better alternative. 

Saddled with relative measures of student performance, it is liQ>ortant 
to find an entre to estimating failure rates. One way is to focus on group 
discrepancies in rate of scholastic failure. It may be possible to use 
these disparities for identifying instructional deficiencies. For example. 
It can be argued that the principal deficiency in public school instruction 
lies in its ineffectiveness for virtually all minority groups. Accordingly , 
It is worthwhile to examine the phenomenon of group inequality and its 
implications for identifying Instructional deficiencies. 

Group inequalities In scholastic success are easy to display. A common 
way is to select two groups such as white students f rom mlddle--class famlllee 
and black students fron poor faoiUles and to collect data on the grades 
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received and the standardized test scores obtained by students In the two 
groups. This method Is Illustrated In a study recently reported by McCandlesSy 
Roberts and Starnes (1972) • Among the samples of seventh-grade children 
drawn from Atlanta Public Schools were a white mlddle-cla&s group and a 
black -lower-class group. Average grades were computed for each sample In 
subjects like readings arithmetic^ language, science and social studies. 
Similarly » average grade-equivalent scores were computed from standardized 
test Information In these subject matter areas. 

The results were that the average grade obtained by white middle- 
class students was B minus while that obtained by black lower-class students 
was C. The two groups were also discrepant in terms of grade-equivalent 
scores on standardized tests with the black students f^om poor families 
trailing the white middle-class students by more than a "year^' on the scale. 
These outcomes are fairly representative of the results wherever studies 
of this kind are conducted and they demonstrate that there are group 
inequalities in scholastic success. 

In my viewj such inequalities clearly signal the existence of instruc- 
tional deficiency 9 but I do not think they accurately locate the source of 
the deficiencies. For example^ group inequalities are compatible with the 
proposition that instructional deficiency is really a set of deficiencies 
in certain students that can be compensated for through special educatiomJ. 
provisions. In practice^ this proposition has materialized in the form 
of offering additional Instruction to those who fail to profit from 
instruction normally offered. This strategy would be defensible if it 
worked and if normal instruction were successful for a vast majority of 
the population. Unfortunately, we have little evidence that coiqiensatica 
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works. Whether compensatory experiences take the form of additional pre-school 
Instruction or the form of additional, remedial. Instruction after formal 
school entry, they appear to have little enduring effect as Judged by 
measures of subsequent scholastic performance (Parker & Tombarl, 1972) • 
I hurry to qualify this statement by recognizing that the issue is ?iot 
closed and that the evidence is not conclusive. Nevertheless, the assessment 
I have offered is, at present, at least as well-supported as the alternative. 

Even if the compensatory proposition could survive the test of 
effectiveness ^ it would founder badly on a second kind of test. Like any 
other set of special arrangements in society, compensatory programs make 
sense only if normal arrangements are effective for a very substantial 
majority of the population. It is questionable that normal instruction 
satisfies this requirement. If not, then it seems more sensible to alter 
normal instruction rather than to try somehow to compensate for its 
deficiencies. Thus, the possibility that normal instruction is largely 
ineffective deserves consideration. 

School grades and standardized test scores can be used to examine the 
effectiveness of normal instruction so long as we keep In mind that both 
are essentially relative measures. Because of this, in order to use them 
at all, it is necessary to designate a cut-off point that defines failure 
on each of the scales, that is, school grades and test scores. One way of 
choosing such points is to imitate what we do in the case of group 
inequalities. When we compare the average performance of white middle- 
class and black lower-class students, for example, we conclude that the 
mean levels associated with the black, lover-class population indicate 
scholastic failure. Accordingly, let us define the cut-off point ea either 



grades or test scores lower than the average obtained by black students 
from lower-class homes. 

Using this cut-off point and assuming that the data reported by 
McCandless et al. (1972) are representative of the country at large » estimates 
of scholastic failure can be calculated from Information provided by the 
Bureau of Census. In 1969 » the number of white children from middle-class 
families (annual Income between seven and fifteen thousand dollars) was 
32.4 million; the total number of black children from poor families (annual 
income below five thousand dollars) was 3.6 million. The failure rates 
in the two populations are» of course » discrepant: 33% for middle-clasB 
whites and 50% for lower-class blacks. When these rates are converted 
to absolute members » a total of some 12*6 million children in the United 
States are expected to meet scholastic failure. Of this total» middle- 
class white children constitute a staggering 10.8 million. Let me emphasize 
this point » the estimate is that more than 10 milllont a full third of the 
population of middle-class white children can be expected to encounter 

scholastic failure. Thus» even if present grpup inequalities were fully 
diminished » a huge number of children would continue to suffer scholastic 
failure. 

In order to believe that normal instruction is defensible » it is crucial 
to show that it is effective for that portion of the population usually 
regarded as well-prepared for school* namely* the white middle-class 
population. But* normal instruction appears Inadequate for fully a third 
of this group. Adding this to the even larger proportions of other groups 
that fall below the cut-off point for scholastic success* normal Instruction 
appears ineffective for betwean 40 and SOZ of the total population* And* 
If a more stringent criterion were applied—mastery > for exaiqile—normal 
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Instruction would have to be regarded as Ineffective for an absolute majority 
of the national population. 

In view of these estimates » a compensatory strategy for Improving 
the effectiveness of instruction seems to be grossly Inappropriate. 
Adopting such a strategy entails providing compensatory experiences for 
the bulk of the population. A plausible Inference from the estimates 
Is that the deficiency lies In normal Instruction » not In the students 
It Is supposed to serve. Accordingly* It Is reasonable to work for 
changes In normal Instruction Itself with the goal of establishing 
schooling that assists all students in learning successfully. 

Research for Instructional Change 

The conclusion that normal instruction must be changed is only a 
starting point for discussion. Indeed » if normal instruction la as inadeqtiate 
as the preceding examination suggests » it will not only have to change , it 
will have to change radically. To repeat myself » research must be designed 
to appraise changes that have the potential of making significant > large-* 
scale » differences in the outcomes of instruction. 

This kind of research task imposes special requirements on investigators. 
The most demanding of these is that of finding variables to manipulate that 
promise to produce truly massive effects. Let me offer a possible strategy 
that might facilitate the search for such effects. 

The strategy is so simple that I am a little embarrassed to describe 
it. It consists of only three steps. The first la to define* classify, and 
schedule objectives of instruction In terms of student performance. The 
second step Is to analyze the performances to produce a specification of 
the demands they make on learners and to find analagous non-school tasks that 



make these same demands. These are the tasks that can be used for research 
purposes. The third step Is to formulate and test hypotheses that Identify 
the principal sources of variance In attaining mastery of these tasks. Once 
these steps are accomplished ^ It should be possible to make recommendations 
for Instructional change. Implement the recommendations » and evaluate their 
efficacy in terms of the objectives previously defined. 

Hypotheses About Principal Sources of Variance 

Th(fii third step, formulating hypotheses » Is probably the most challenging 
This step of the strategy Is dictated by two considerations. One Is the 
goal of locating Instructional variations that promise to make significant 
differences la outcomes. The second consideration Is our track record In 
educational research. The first consideration has already been discussed 
at some length. The second deserves at least brief expiration.- 

When I refer to our track record » I am not expressing dismay at the 
quality of our research and theorizing » even though these efforts deserve 
constant scrutiny and criticism. Instead » I am trying to convey my dlstresc 
at the apparently marginal Impact our research has had on educational 
practices asid outcomes. Most of you probably share my frustration about 
this 9 some of you to the point of believing that we have enough research 
and theory In hand: what we lack are effective ways of Insuring that It Is 
disseminated and Implemented. But^ I want to take an alternative position^ 
that our research has not f ocussed on ^variation that promises to make large 
differences In outcomes. 

Reflect for a moment on the gross aspects of Instruction. Between the 
time a chfld enters Che first grade and completes the sixth » he has Invented 
more than 5000 hours in school rooios. If he began school during the last ten 
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years* the child has had the benefit of new Instructional materials and 
procedures 9 many of which-- In reading and math» for example — have been 
hailed as revolutionary. Yet, after all of this variation In Instructional 
conditions, techniques, and arrangements, and after 5000 hours of It, we are 
told that massive numbers of children leaving the sixth grade have not yet 
learned to read and compute adequately. Worse, as far as we know, these 
children have not 3 earned to do anything well. It is staggering to believe 
that they have learned virtually nothing of what was Intended for them 
after the magnitude of their investmc. and ours, over that span of time. 

It is not enough to counter this observation by asserting that 
materials and procedures have been improperly used, or that only a portion 
of the 5000 hours is actually devoted to instruction. If these assertions 
are true, than I fail to see how continuing our present course in educational 
research promises to result in any change. 

These considerations, it seems to me, call for a change in the focus 
of our research: from attempts to improve current forms of Instruction to 
a search for ways of utterly replacing present Instructional patterns with 
new ones. 

If so, the next question is where to look for changes that might make 
a difference. There are a number of possibilities, but let me draw 
attention to Just two of them: age of the student, and the topic of learning. 

Student Age . Think of virtually any intellectual task that we know 
about. With only a few exceptions, the data, indicate that the older the 
student, the more efficiently and effectively he can learn to perform the 
task; moreover, the more likely that what he learns will be transferable. 



This generalization seems to hold over an Impressively broad range of tasks: 
associative learning; memorization; concept learning; and problem-solvlngt 
whether the tasks are from a Genevan mold or from an American mold. Thus» 
In my view, student age Is a likely candidate for an Instructional change 
that might make a difference. 

The change Implied by this suggestion, of course » Is In the ages at 
which school performances aro Initially required. Bluntly » the Imposition 
of these requirements should be markedly delayed. The hypothesis Is that 
such delays would greatly facilitate the eventiaal acquisition of almost any 
skill or content we might designate. 

X recognize that this h^^pothesls rests on a slnqple minded observation. 
I also recognize that It runs counter to an exceedingly strong tide In the 
direction of Imposing requirements earlier In the child's life. And I 
recognize that the hypothesis frustrates the need to accelerate children 
intellectually. Still » I marvel that we have not yet made even a half-- 
hearted test of It. 

Learning Topic . Another hypothesis arises from an observation that is 
nearly as obvlouB as the one concerning age. Persons differ in the kinds 
of learning they can accomplish with facility and eagerness. Any of us 
could readily supply numerous anecdotes in support of this assertion but we 
can also call on <3ven more convincing evidence. For example » so far* the 
search for a general learning ability has taught us that it Just isn't 
there (Stevenson » Hale » Klein » & Miller » 1968). General ability seems 
to be reflected by instruments such as intelligence tests that index what 
has been learned previously » but not by instruments that directly measure 
a vide variety of learning. Even FlagiBtian theory could not survive without 
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the complicated notion of decalage (Plaget» 1972). 

Let me emphasize that I am referring here to gross variations In topics 
and types of learning, not to variations of procedure within a single task. 
Thus» this hypothesis concerns the possibility that Individuals differ widely 
in the ease and Joy with which they accomplish different types of learning: 
reading vs. mathematics; science vs. social studies; observation vs. 
analysis; Interpersonal skills vs. the skills. of academic inquiry, and so 
on. If they do, the implication might be to alter drastically the 
requiremente of scholastic success to provide a range of topical achievement 
broad enough to accomodate the range of individual variation in taste 
and facility. > 

I anticipate that this hypothesis will be seen by some as a recommenda- 
tlov. in favor of watering down the academic content of schooling. This is 
not the Intent. Instead, the point is that there is a startling variety 
of skills and contents that are worth learning, but normal instruction is 
directed to only a small fraction of these. Why not broaden the sweep of 
instruction. After all, as I have argued elsewhere (Rohwer, 1971) we have 
preciouis little evidence that doing well in school, as it is now constituted, 
is relevant for anything except doing well in school. Accordingly, there ±b 
little to risk and an enormous amount of possible gain in exploring the 
validity of the hypothesis that competence might be enhanced by instruction 
that offers, and honors, widely varying kinds of achievement. 

Possible Conges in Instruction * 

Given these two hypotheses, let me conclude by speculating about what 
Instruction might be like if research were to produce evidence of their 
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viability, 

vniat would schooling be like if it were organized to capitalize on 
age and topical differences among children? The st^cture and procedures 
of schooling would need to be revised along several lines. First among the 
revisions would be an explicit confession that the aim of schooling is to 
Insure student achievement at the end rather than at the beginning of the 
educational process. Even though high school education surely needs reform 
as much as elementary schooling, assume » for the time being » that the purpose 
of the early years is to prepare for success in high school; in the intermediate 
or junior high school years » students would acquire the skills necessary to 
meet the demands of high school* In general » these demands would be for 
acquaintance with the conceptual structure* the methods of» and the informa- 
tion produced by a variety of disciplines— mathematics » literature, physical 
and biological science, psychology and so on. Obviously, students will 
make choices within this array as well as among various types of work 
necessary to acquire skills associated with clerical, mechanical and 
technical fields « Accordingly, the landmarks to be reached by the end of 
the intermediate school years— -seventh p eighth, and ninth grades—consist 
of the prerequisites for these demands* 

The prerequisites are relatively small in number. Chief among the 
skills in which instruction should be offered are reading and mathematics. 
The aim of reading instruction would be to assist students in learning to 
read rapidly and with comprehension. In other words, reading instruction would, 
be designed to foster the skills of gleaning relevant information from 
printed material as efficiently as possible. In arithmetic, the aim would 
be to help students In acquiring the fundami^ntal concepts and com;putational 
skills of elementary mathematlca~very much the same material as Is now 
required In the first six grades of elementary school* Instruction would 
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also be offered In a number of other skills. One of these would concern 
memorization and would Include tactics for organizing material to Increase 
Its memorability. Assistance would be offered In the development of 
communication sklll8--lnterpretlng and framing answers to questions » planning 
and preparing reports > methods of exploiting Information sources such as 
libraries and people, lucid expression of Ideas orally and In writing. 
Finally, Instruction would be provided to foster thinking and problem 
solving skills. Including methods for generating and evaluating Ideas. 
Mastery of all of the skills mentioned woulidTbe-mandatory for all students. 

Besides work In the acquisition of various mandatory skills, Instruc*- 
tlon should be available In a number of elective skills as well. Typically, 
the elective skills would be more closely allied with particular disciplines 
than the mandatory skills. Students might practice various methods associated 
with scientific observation and experimentation, collect data on public 
opinion, learn Interpersonal skills, acquire techniques of computer 
programming, attempt to teach younger children, conduct library research 
on topics of individual Interest, analyze the structure, population, and 
sources of conflict In the local community, and so on. 

Given this sketch of the curriculum for the intermediate years, what 
would schooling be like during the elementary years — the first six or seven 
grades of public school? This question can be answered by resolving the 
issue of what students need to be able to do in order to profit from the kind 
of schooling envisioned for the junior high school years. Here Is where the 
proposed revision departs most obviously from the present structure of 
schooling. There would be no mandatory subjects— in the traciitional sense— 
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for the elementary school years. Reading competence would not be required 
s:Lnce reading Instruction would be offered In Junior high. Nor would 
arithmetic competence, nor competence In language arts» social studies, 
aiid science. As requirements » no one of these achievements would be required 
of all students. And no student would be expected to have achieved them all- 
ot any single one of them, not even reading-- by the time he enters the 
seventh grade. It would be the task of the Intermediate school » not the 
elementary school » to look after formal m^andatory Instruction In these skills 
aiid disciplines. 

Even aOf there would be substantial work to be done in elementary school* 
This work would be relevant for the demands of Junior high school; but» it 
would not supplant those demands by mklng them prematurely. The mandatory 
curriculum for elementary school would require that students select topics 
for study» do extended work on the topics, and succeed in the work. Success 
here refers especially to the quality of the work done and to completing 
the work planned. The tuples available for choice should range widely and 
include all of those that will be available at later grade levels — readings 
math» history, geography, sciences and so on. Sufficient latitude should 
be given so that a student could also select topics not usually Included 
in public school curricula such as computer programming or the lore of 
professional baseball. Opportunities to acquire interpersonal skills should 
also be made available, especially in view of the enormous amount of the 
child's time that is normally devoted to dealing with his relationships 
with teachers and other students. In general, the elementary school curriculim 
would be designed to afford children repeated experiences of what work is like 
and what success in school work is like. 
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In an elementary school of the kind envisioned » the teacher would have 
three major functions: offering guidance In the selection of topics; pro- 
viding encouragement and resources necessary for the child to pursue his 
work on a topic; and giving suggestions and support to aid the child In 
Improving his work on the topic « With regard to the selection of topics p 
the guidance function would be extremely Important. It would be the 
teacher's task to determine whether or not a child has a reasonable chance 
of succeetdlng In hla work on each of the topics chosen. For example. If 
a child wished to learn to read, the teacher would need to determine that 
the child could do so without so much difficulty that It would defeat the 
purpose of the elementary years. 

The task of providing encouragement would not be an onerous one, but 
that of making resources available could be quite demanding. Here the teacher 
would havB to be supplied with resources by those who develop curriculum 
materials. Such materials would have to meet two principal standards: 
that they could be used by the elementary school child without substantial 
adult guidance; and that their use not require skill In an unrelated subject. 
For example, curriculum materials to be used In work on scientific topics 
should not require reading skill as a prerequisite. That this standard 
can be met has already been demonstrated In the elementary school science 
curriculum developed under the auspices of the American Association for 
the Advancement of Science. 

Lastly, the function of giving assistance to the child In lnqprovlng 
his work would replace the present practices of grading a child's work and 
of using standardized tests of achlevtiment to determine his progress. 
Clearly, under the system of schooling envisioned such methods of evaluating 
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students would be Inapplicable. The work of elementary school students would 
be so diverse that It would not be feasible to construct standardized tests. 
Instead, the method of suggestions leading to improvement would both 
encourage and demand success of the child in producing completed work of 
high quality.; 

A two-part rationale can be given for revising schooling-ln the manner 
proposed. First, there is reason to hope that the type of elementary 
schooling envisioned here will significantly diminish, if not completely 
remove, thie experience of academic failure in the lives of young children. 
This should allow virtually all children to embark on the Intermediate 
years of formal instruction with feelings of genuine liking for learning 
rather than the fear and hostility that so 'many children bring to those 
years at present. 

The second part of the rationale tests on a dual proposition: that 
all of the learning necessary for success in meeting high school demands 
can be accomplished in only two or three years — the Junior high school 
years; and that delaying the beginning of prescribed instruction until 
those years holds promise for many children of increasing the ultimate 
degree of academic success they can achieve (cf . Humphreys, 1971; Elkind, 
1969; Rohwer, 1971). 

So far, there is no real proof that the system of schooling I have 
sketched would solve the problems of Instructional def icii^ncies. But 
advance proof is not the issue* In fact, the only way to obtain proof is to 
do the necessary research. The real issue is whether or not the rationale 
for the system Is plausible enough to warrant a test. Overall, I think it is. 
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